Control method of playing content and content playing apparatus performing the same

ABSTRACT

An example content playing apparatus includes an output unit configured to output an image and voice; a user recognition unit configured to recognize a plurality of users viewing content played by the output unit; and a controller configured to select at least one of the plurality of users based on predetermined criteria and control playing of the content according to the at least one selected user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/783,228, filed on Oct. 8, 2015, which is a national stage applicationof International Patent Application No. PCT/KR2015/002537, filed on Mar.16, 2015, which designates the United States, and which claims priorityto Korean Patent Application No. 10-2014-0030675, filed Mar. 16, 2014,and to Korean Patent Application No. 10-2014-0098586, filed Jul. 31,2014. The contents of each of these applications are incorporated hereinin their entirety.

BACKGROUND AND SUMMARY

The inventive concept relates to a method of controlling playing ofcontent viewed by a plurality of users and a content playing apparatusperforming the method.

When it is assumed that users view the same content, for example, whenthe users watch TV at home, the content may include some inappropriatematerial for some of the users, or content that some of the users prefernot to watch may be played.

A method of controlling playing of content by taking into account usersviewing the content is suggested to solve the above problems. Sincecriteria such as age, preference, etc. of each user differs for eachuser, it is necessary to find the most appropriate method of controllingplaying of the content by taking into account the users based onpredetermined criteria.

The inventive concept provides a method of controlling playing ofcontent according to a plurality of users viewing the content when theplurality of users view the content together, and an apparatus therefor.

According to one or more exemplary embodiments, at least one user isselected based on predetermined criteria from among a plurality of usersviewing the content, and content is played according to the at least oneselected user.

Playing of content viewed by a plurality of users may be appropriatelycontrolled.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an environment in which a method of controlling playing ofcontent is implemented according to an exemplary embodiment.

FIG. 2 is a flowchart of a method of controlling playing of content,according to an exemplary embodiment.

FIGS. 3, 4 and 5 are views for explaining a method of controllingplaying of content, according to an exemplary embodiment, the methodincluding selecting a youngest user according to previously stored ageinformation of users.

FIGS. 6, 7, 8, 9, 10, 11, 12 and 13 are views for explaining variousmethods of controlling playing of content by a content playing apparatuswhen prohibited scenes are included, according to exemplary embodiments.

FIG. 14 is a flowchart of a method of controlling playing of content,according to an exemplary embodiment in which a youngest user isselected based on previously stored age information of users.

FIGS. 15, 16 and 17 are views for explaining methods of controllingplaying of content, according to exemplary embodiments, the methodsincluding predicting the ages of users based on user recognition andselecting the youngest user.

FIGS. 18 and 19 are flowcharts of methods of controlling playing ofcontent, according to exemplary embodiments, the methods includingpredicting the ages of users based on user recognition and selecting theyoungest user.

FIG. 20 is a view for explaining a method of controlling playing ofcontent, according to an exemplary embodiment, the method includingusing age information input by users when prediction of the ages of theusers fails and selecting the youngest user.

FIG. 21 is a flowchart of a method of controlling playing of content,according to an exemplary embodiment, the method including using ageinformation input by users when prediction of the ages of the usersfails and selecting the youngest user.

FIGS. 22 and 23 are views for explaining methods of controlling playingof content when another user is added who views the content and the agesof existing users are stored in the content playing apparatus, accordingto exemplary embodiments.

FIG. 24 is a flowchart of a method of controlling playing of contentwhen another user is added who views the content and the ages ofexisting users are stored in the content playing apparatus, according toan exemplary embodiment.

FIGS. 25 and 26 are views for explaining a method of controlling playingof content when some users viewing the content leave and the ages ofexisting users are stored in the content playing apparatus, according toan exemplary embodiment.

FIG. 27 is a flowchart of a method of controlling playing of contentwhen some users viewing the content leave and the ages of existing usersare stored in a content playing apparatus, according to an exemplaryembodiment.

FIGS. 28, 29, 30 and 31 are views for explaining a method of controllingplaying of content when the number of users viewing the content changesand the ages of the users are not stored in the content playingapparatus, according to an exemplary embodiment.

FIG. 32 is a flowchart of a method of controlling playing of contentwhen the number of users viewing the content changes and the ages of theusers are not stored in the content playing apparatus, according to anexemplary embodiment.

FIGS. 33 and 34 are views of explaining a method of controlling playingof content when conversations between users are analyzed and predictingthe addition of a user, according to an exemplary embodiment.

FIG. 35 is a flowchart of a method of controlling playing of contentwhen conversations between users are analyzed and predicting theaddition of a user, according to an exemplary embodiment.

FIGS. 36 and 37 are views for explaining a method of recognizing userswhen content being played changes and of controlling playing of content,according to an exemplary embodiment.

FIG. 38 is a flowchart of a method of recognizing users when contentbeing played changes and of controlling playing of content, according toan exemplary embodiment.

FIGS. 39 and 40 are views for explaining methods of periodicallyrecognizing users and controlling playing of content, according toexemplary embodiments.

FIG. 41 is a flowchart of a method of periodically recognizing users andcontrolling playing of content, according to exemplary embodiments.

FIG. 42A is a view for explaining a method of restricting channelssearchable by a user according to the age of a selected user.

FIG. 42B is a flowchart of a method of restricting a search of channelsaccording to a user selected based on ages, according to an exemplaryembodiment.

FIG. 43A is a view of a method of restricting playing of contentaccording to a user selected based on ages when a channel changes,according to an exemplary embodiment.

FIG. 43B is a flowchart of a method of restricting playing of contentaccording to a user selected based on ages when a channel changes,according to an exemplary embodiment.

FIGS. 44 and 45 are views for explaining a method of displaying apreferred channel according to a user selected based on an actionrecognition result, according to an exemplary embodiment.

FIG. 46 is a flowchart of a method of displaying preferred channelsaccording to a user selected based on an action recognition result,according to an exemplary embodiment.

FIG. 47 is a view for explaining a method of determining and displayingpreferred channels based on channel histories of users, according to anexemplary embodiment.

FIG. 48 is a flowchart of a method of determining and displayingpreferred channels based on channel histories of users, according to anexemplary embodiment.

FIG. 49 is a view for explaining a method of determining and displayingpreferred content based on a channel history of each user, according toan exemplary embodiment.

FIG. 50 is a flowchart of a method of determining and displayingpreferred content based on channel histories of users, according to anexemplary embodiment

FIG. 51 is a view of a structure of a display apparatus configured tosupport a content playing control function, according to an exemplaryembodiment.

FIG. 52 is a view of a system for controlling playing of content,according to an exemplary embodiment.

FIG. 53 is a view of detailed structures of devices included in thesystem of FIG. 52, according to an exemplary embodiment.

FIG. 54 is a view of detailed structures of devices included in thesystem of FIG. 52, according to another exemplary embodiment.

FIG. 55 is a view of a system configured to control playing of content,according to an exemplary embodiment.

FIG. 56 is a view of detailed structures of devices included in thesystem of FIG. 55, according to an exemplary embodiment.

FIG. 57 is a view of a system for controlling playing of content,according to an exemplary embodiment.

FIG. 58 is a view of detailed structures of devices included in thesystem of FIG. 57, according to an exemplary embodiment.

DETAILED DESCRIPTION

According to one or more exemplary embodiments, there is provided acontent playing apparatus including: an output unit configured to outputan image and voice; a user recognition unit configured to recognize aplurality of users viewing content played by the output unit; and acontroller configured to select at least one of the plurality of usersbased on predetermined criteria and control playing of the contentaccording to the at least one selected user.

The user recognition unit may be configured to determine ages of theplurality of users based on at least one of faces, voices, and bodyshapes of the plurality of users, and the controller may be configuredto select the youngest user from among the plurality of users andrestrict playing of content which the youngest user is not allowed toview.

The controller may determine a viewing rating based on analysis of thecontent and compare the determined viewing rating against the age of theyoungest user in order to determine whether the youngest user is allowedto view the content.

The user recognition unit may be configured to detect a change in thenumber of users viewing the content being played, and the controller maybe configured to repeat the selection of at least one of the pluralityof users when the number of users changes.

The controller may be configured to predict at least one additional userbased on analysis of voices of the plurality of users viewing thecontent being played, the voices included in conversations between theplurality of users, and select at least one user from among theplurality of users and the predicted at least one additional user.

Based on changes to the content played through the output unit, the userrecognition unit may be configured to repeat the recognition of theplurality of users viewing the content, and the controller may beconfigured to repeat the selection of at least one of the plurality ofrecognized users.

The user recognition unit may be configured to periodically recognizethe plurality of users, and the controller may be configured toperiodically select at least one of the plurality of users.

The user recognition unit may be configured to recognize activities ofthe plurality of users, and the controller may be configured to selectat least one user performing a predetermined activity from among of theplurality of users and control playing of the content according to apreference of the at least one selected user.

The controller may be configured to display, on the output unit, a listof channels or a list of content preferred by the at least one selecteduser.

According to one or more exemplary embodiments, there is provided amethod of controlling playing of content, the method including:recognizing a plurality of users viewing the content; selecting at leastone of the plurality of users based on predetermined criteria; andcontrolling playing of the content according to the at least oneselected user.

The recognizing may include determining ages of the plurality of usersbased on at least one of faces, voices, and body shapes of the pluralityof users. The selecting may include selecting the youngest user fromamong the plurality of users. The controlling may include restrictingplaying of content which the youngest user is not allowed to view.

The controlling may include: determining a viewing rating based onanalysis of the content; comparing the determined viewing rating againstthe age of the at least one selected user in order to determine whetherthe at least one selected user is allowed to view the content; andrestricting playing of at least some pieces of the content if theyoungest user is not allowed to view the pieces of the content.

The recognizing and the selecting may be performed whenever the numberof users viewing the content changes.

The recognizing may include: predicting whether at least one additionaluser will view the content based on analysis of voices of the pluralityof users in conversations between the plurality of users; and selectingat least one user from among the plurality of users and the predicted atleast one additional user.

The recognizing and the selecting may be performed whenever the contentbeing played changes.

The recognizing and the selecting may be periodically performed.

The recognizing may include recognizing activities of the plurality ofusers. The selecting may include selecting at least one user performinga predetermined activity from among the plurality of users. Thecontrolling may include controlling playing of the content according toa preference of the at least one selected user.

The method may further include displaying, on a screen, a list ofchannels or pieces of content preferred by the at least one selecteduser.

The inventive concept will now be described more fully with reference tothe accompanying drawings, in which exemplary embodiments of theinventive concept are shown. These exemplary embodiments are provided sothat this disclosure will be thorough and complete, and will fullyconvey the concept of the inventive concept to those skilled in the art.Detailed description regarding features well known to one of ordinaryskill in the art will be omitted.

FIG. 1 shows an environment in which a method of controlling playing ofcontent is implemented according to an exemplary embodiment.

Referring to FIG. 1, users A, B, and C view content played by a displayapparatus 1000. The display apparatus 1000 may be connected to a userrecognition apparatus 1100 for recognizing a user who views the contentand a content playing apparatus 1200 for controlling playing of thecontent.

The method of controlling the playing of the content is implemented whena plurality of users view the same content together. The displayapparatus 1000 shown in FIG. 1 is a TV, but may be another apparatus,for example, a tablet computer, a smart phone, or a laptop, which has adisplay function. In this case, the content may include various types ofinformation, for example, text, voice and sound (music), images, videos,broadcasts, applications, games, e-books, etc. The playing of thecontent means that videos, images or voices (music) of broadcasts areplayed, games or applications are executed, or content of e-books aredisplayed on a screen.

Since the content may include some material inappropriate for or notpreferred by the users viewing the content, the playing of the contentneeds to be controlled by using a method of reprocessing the contentwhen playing the content, of stopping playing of the content, ofrecommending content, or the like. When there are a plurality of usersviewing the content, as shown in FIG. 1, there may be a problemregarding which user the playing of the content will be based on. In thepresent exemplary embodiment, the content playing apparatus 1200 selectsat least one of the users according to predetermined criteria andcontrols playing of the content according to the selected user or users.

The criteria relate to demographic features of the users viewing thecontent, for example, a minimum age, gender, preference for content,relationship between the users, or the like.

The user recognition apparatus 1100 may recognize the users viewing thecontent. Recognition means that the existence of users is identified, orcharacteristics of the users are extracted and analyzed.

The content playing apparatus 1200 uses various pieces of userinformation obtained from recognition results of the users so as toselect at least one of the users according to predetermined criteria andcontrols the playing of the content according to the selected user orusers.

Detailed examples in which the content playing apparatus 1200 recognizesthe users and obtains the user information are as follows. The contentplaying apparatus 1200 may recognize faces, body shapes, voices, etc. ofthe users via the user recognition apparatus 1100 and compare the samewith the previously stored user information, and thus, the users may beidentified or the ages, preference, etc. of the users may be checked.Alternatively, when no user information has been stored in advance, thecontent playing apparatus 1200 recognizes the faces, body shapes,voices, etc. of the users and may predict the ages, etc. of the usersbased on analysis of the recognized faces, body shapes, voices, etc.Alternatively, the content playing apparatus 1200 may recognize a userbased on actions performed by the users. Detailed descriptions withregard to recognizing other users and obtaining user information will beprovided below.

The content playing apparatus 1200 may select at least one of the usersby using the user information obtained after the users are recognized.In this case, the users may be selected according to certain criteria.For example, the content playing apparatus 1200 may select the youngestuser when age information of the users is obtained or a user whoperforms certain actions. In addition, the content playing apparatus1200 may select users according to various criteria.

When a user is selected, the content playing apparatus 1200 may controlplaying of the content according to the selected user. The contentplaying apparatus 1200 may control playing of the content according tousers by taking into account various criteria. For example, the contentplaying apparatus 1200 may control the playing of the content accordingto the ages of the users or to the preference of the users. If theyoungest user is selected, the content playing apparatus 1200 comparesthe selected user against a viewing rating of the content in order todetermine whether the selected user may view the content. If it isdetermined that the selected user is not allowed to view the content,some material included in the content is reprocessed so that harmfulscenes are not displayed, or playing of the content may be stopped.Alternatively, when it is determined that a user in control of contentselection (e.g., a user inputting commands via a remote control) isselected, the content playing apparatus 1200 may recommend a list ofchannels or content preferred by the selected user by simultaneouslydisplaying the content and the list.

The content playing apparatus 1200 may select two or more users fromamong the plurality of users. When the two or more users are selected,the content playing apparatus 1200 may control the playing of thecontent by taking into account the ages or preference of the selectedusers.

Other exemplary embodiments, other than the above exemplary embodiment,may be implemented and will be described with reference to the drawingsbelow.

According to one or more exemplary embodiments to be described below,processes of controlling playing of the content are performed by thecontent playing apparatus 1200. However, some or all of the processesmay be performed by the display apparatus 1000 or another server. Thatis, the processes may be performed by various devices in accordance withstructures of systems. Exemplary embodiments regarding the structures ofthe systems will be described with reference to FIGS. 51 to 58.

FIG. 2 is a flowchart of a method of controlling playing of content,according to an exemplary embodiment.

Referring to FIG. 2, a content playing apparatus recognizes a pluralityof users viewing content in operation 201. In this case, the contentplaying apparatus may recognize faces, body shapes, voices, etc. of theusers.

After the faces, body shapes, voices, etc. of the users are recognized,the content playing apparatus selects at least one of the usersaccording to predetermined criteria in operation 202. For example, thecontent playing apparatus may select the youngest user or a user whoperforms a certain action.

In operation 203, the content playing apparatus controls playing of thecontent according to the selected user. For example, the content playingapparatus determines whether the selected user is allowed to view thecontent by comparing the age of the selected user against a viewingrating of the content. If the selected user is not allowed to view thecontent, the content playing apparatus may stop playing of the contentor reprocess the content and display the reprocessed content on ascreen.

Accordingly, the content playing apparatus recognizes users and selectsat least one of the users according to predetermined criteria. Then, thecontent playing apparatus controls the playing of the content accordingto the selected user or users such that the content playing apparatusmay control the playing of the content based on a plurality of usersviewing the same content.

FIGS. 3 to 5 are views for explaining a method of controlling playing ofcontent, according to an exemplary embodiment, the method includingselecting a youngest user according to previously stored age informationof users. Hereinafter, the method will be described in detail withreference to FIGS. 3 to 5.

Referring to FIG. 3, the users A, B, and C view content played by thedisplay apparatus 1000. The user recognition apparatus 1100 recognizesthe multiple users viewing the content. As shown in FIG. 3, the userrecognition apparatus 1100 is a camera separated from the displayapparatus 1000, but the user recognition apparatus 1100 may be embodiedin different forms. For example, the user recognition apparatus 1100 maybe a camera installed in a frame of the display apparatus 1000.

Referring to FIG. 4, the user recognition apparatus 1100 and the contentplaying apparatus 1200 perform facial recognition with regard to usersviewing content. Since technology regarding facial recognition is wellknown, detailed descriptions thereof will be omitted. Briefly, facialrecognition may be performed by capturing images of the users,identifying portions of faces of the users from the captured images,analyzing a symmetric facial structure, appearance, hair, colors of theeyes, movements of facial muscle, etc. of each user, and extractingcharacteristics of the users.

When facial recognition with regard to the users is completed, thecontent playing apparatus 1200 determines the ages of the users based onpreviously stored age information of the users. Age information of atleast one user may be stored in a storage unit included in the contentplaying apparatus 1200 in advance. The age information of the users maybe formatted such that the ages of the users are respectively mapped tothe images of the users (see the table 410 of FIG. 4).

The content playing apparatus 1200 may compare the recognized faces ofthe users with the images thereof stored in a table 410 so as todetermine the age of each user. Referring to the table 410 of FIG. 4,the content playing apparatus 1200 may determine that the users A, B,and C are 34 years old, 17 years old, and 6 years old, respectively.

FIG. 4 shows the user recognition apparatus 1100 and the content playingapparatus 1200 which determine the ages of users by recognizing thefaces of the users. However, the user recognition apparatus 1100 and thecontent playing apparatus 1200 may recognize the body shapes, voices, orthe like of the users and may determine the ages of the users bycomparing the recognized body shapes, voices, or the like against thepreviously stored age information of the users. In this case, the ageinformation of the users may be in a table form in which the ages of theusers are mapped to information with regard to the body shapes, voicesof the users.

Once the ages of the users have been determined, the content playingapparatus 1200 selects at least one of the users based on the ages ofthe users, according to the predetermined criteria. FIG. 4 shows thecontent playing apparatus 1200 selecting the youngest user, that is, theuser C.

Once at least one of the users has been selected, the content playingapparatus 1200 controls the playing of the content according to theselected user. That is, the content playing apparatus 1200 controls theplaying of the content according to the user C.

FIG. 5 shows playing of content based on a determination of whether thecontent is inappropriate for a selected user, in which the determinationis based on a comparison of the age of the selected user and a viewingrating of the content. Referring to FIG. 5, the content playingapparatus 1200 receives the viewing rating of the content from a contentprovider and compares the received viewing rating with the age of theselected user, that is, the user C. The viewing rating received by thecontent playing apparatus 1200 from the content provider is a maturerating, and the user C, the selected user, is 6 years old. Thus, thecontent playing apparatus 1200 determines that the user C is not allowedto view the content.

If the content provider does not provide the viewing rating of thecontent, the viewing rating of the content may be determined based on ananalysis of the content. For example, the viewing rating of the contentmay be determined by checking whether each image frame of the contentincludes material harmful to minors. In this case, analysis of thecontent and determination of a viewing rating may be performed by acloud server or the content playing apparatus 1200. Alternatively, theviewing rating may also be determined when other users view the samecontent, and the viewing rating may be stored and later used.

Methods of determining a viewing rating of content based on an analysisof the content may vary. For example, the server or the content playingapparatus 1200 may determine whether each image frame of the contentincludes harmful material based on analysis of the image frames of thecontent or based on analysis of voices included in the content. Inparticular, according to the method of determining whether the imageframes of the content includes harmful material based on analysis of thesame, the server or the content playing apparatus 1200 recognizesobjects included in each image frame of the content, and whether therecognized objects correspond to harmful objects such as knives, guns,or cigarettes. Alternatively, the server or the content playingapparatus 1200 recognizes body parts of a person from the image framesof the content and may determine whether any nudity is included in theimage frames based on analysis of colors of the recognized body parts ofthe person. Furthermore, the analysis of the content and thedetermination of the viewing rating may be performed by using variousmethods.

Referring back to FIG. 5, since it is determined that the selected useris not allowed to view the content, the content playing apparatus 1200may stop playing of the content or reprocess some material of thecontent in order to control the playing of the content, therebypreventing the selected user from being exposed to harmful material.FIGS. 6 to 13 show detailed examples in which playing of content iscontrolled by the content playing apparatus 1200.

FIGS. 6 to 13 are views for explaining various methods of controllingplaying of content by a content playing apparatus when prohibited scenesare included, according to exemplary embodiments.

Referring to FIG. 6, the content playing apparatus 1200 may stop playingof the content when it is determined that the selected user is notallowed to view the content and may display, on the display apparatus1000, a pop-up message 610 which requests confirmation to continueplaying of the content. Content is played normally on a first screen 600a of FIG. 6, and content is played in combination with the pop-upmessage 610 on a second screen 600 b.

In this case, a message indicating the presence of a user who is notallowed to view content currently being played may be included in thepop-up message 610. Also, when a user inputs a selection to continue toview the content, the content playing apparatus 1200 displays, on thedisplay apparatus 1000, a pop-up message which requires the user toenter a password. Once the user enters the correct password, the playingof the content may resume.

Referring to FIG. 7, the content playing apparatus 1200 may skip scenesincluding harmful material while the content is being played and thenmay continue playing of the content, starting from a subsequent scene.When a scene including harmful material (a smoking scene) is displayedon a first screen 700 a of FIG. 7, the content playing apparatus 1200controls the display apparatus 1000 to skip the scene and resume playingof the content, but without the harmful material.

To skip some scenes of content, a viewing rating of the content andinformation regarding whether harmful material is included in each sceneof the content are necessary. The information may be provided by acontent provider or may be obtained based on an analysis of the contentperformed by the server or the content playing apparatus 1200. Themethod of determining whether the harmful material is included in eachscene of the content based on the analysis performed by the server orthe content playing apparatus 1200 is the same as the method ofdetermining whether harmful material is included in each image frame ofthe content based on analysis of the image frames of the content.

When the content of FIG. 7 corresponds to content stored in the contentplaying apparatus 1200 in advance, the content playing apparatus 1200may skip some scenes and may immediately play subsequent scenes, withouta temporal gap. However, when the content playing apparatus 1200receives content from an external server in real time, there may betemporal gaps while some scenes are being skipped. Therefore, thecontent playing apparatus 1200 may display substitute images during thetemporal gaps. For example, the content playing apparatus 1200 maydisplay substitute images which are stored in advance or may displaytitle information of the content, advertisements, or the like.Displaying the substitute images will be described in detail withreference to FIGS. 10 to 13.

Referring to FIG. 8, the content playing apparatus 1200 may pixelate aportion of a scene being played, the portion corresponding to harmfulmaterial. Harmful material 810 is included in a first screen 800 a ofFIG. 8. Therefore, the content playing apparatus 1200 reprocesses thecontent in order to pixelate the harmful material displayed on the firstscreen 800 a and may display, on the display apparatus 1000, thereprocessed content on a second screen 800 b.

The content playing apparatus 1200 needs to identify which portion of anentire screen includes harmful material in order to pixelate only theportion including the harmful material. Thus, the content playingapparatus 1200 may use information provided by the content provider, maydirectly analyze the content, or may obtain information analyzed by acloud server to use the obtained information. For example, the server orthe content playing apparatus 1200 may recognize objects included ineach image frame of the content and determine whether the includedobjects correspond to harmful material such as knives, guns, orcigarettes. If the harmful material is found, the content playingapparatus 1200 may pixelate portions corresponding to the harmfulmaterial on the entire screen.

Referring to FIG. 9, the content playing apparatus 1200 may blur theentire screen when a scene includes harmful material while the contentis being played. Content is played normally on a first screen 900 a ofFIG. 9, and blurred content is played on a second screen 900 b.

The viewing rating of the content and information regarding whetherharmful material is included in each scene of the content are used fordetermining whether to blur the entire screen. The information may beprovided by the content provider or may be obtained based on an analysisof the content performed by the server or the content playing apparatus1200. The method of determining whether the harmful material is includedin each scene of the content based on the analysis performed by theserver or the content playing apparatus 1200 is the same as the methodof determining whether the harmful material is included in each imageframe of the content based on analysis of the image frames of thecontent.

The content playing apparatus 1200 may stop blurring scenes of thecontent after scenes including harmful material pass.

Referring to FIG. 10, the content playing apparatus 1200 may display, onthe display apparatus 1000, a substitute image for a scene includingharmful material while the content is being played. Content is playednormally on a first screen 1000 a of FIG. 10, and content is played incombination with the substitute image on a second screen 1000 b.

A viewing rating of the content and information regarding whetherharmful material is included in each scene of the content are necessaryto display the substitute image. The information may be provided by thecontent provider or may be obtained based on an analysis of the contentperformed by the server or the content playing apparatus 1200. Themethod of determining whether the harmful material is included in eachscene of the content based on the analysis performed by the server orthe content playing apparatus 1200 is the same as the method ofdetermining whether the harmful material is included in each image frameof the content based on analysis of the image frames of the content.

The substitute image may be stored in the content playing apparatus 1200in advance or may be provided by a cloud server which provides thecontent.

The content playing apparatus 1200 may stop displaying the substituteimage after scenes including harmful material pass.

Referring to FIG. 11, the content playing apparatus 1200 may display atitle 1110 of the content being played instead of playing a sceneincluding harmful material. Content is played normally on a first screen1100 a of FIG. 11, and content is played in combination with the title1110 on a second screen 1100 b.

A viewing rating of the content and information regarding whetherharmful material is included in each scene of the content are necessaryto display the title 1110. The information may be provided by thecontent provider or may be obtained based on an analysis of the contentperformed by the server or the content playing apparatus 1200. Themethod of determining whether the harmful material is included in eachscene of the content based on the analysis performed by the server orthe content playing apparatus 1200 is the same as the method ofdetermining whether the harmful material is included in each image frameof the content based on analysis of the image frames of the content.

In this case, the content playing apparatus 1200 displays the title 1110such that the title occupies almost the entire screen, and thus, scenesincluding harmful material may not be displayed.

The content playing apparatus 1200 may stop playing the title 1110 ofthe content after scenes including the harmful material pass.

Referring to FIG. 12, the content playing apparatus 1200 may display, onthe display apparatus 1000, an advertisement instead of playing scenesincluding harmful material, while the content is being played. Contentis played normally on a first screen 1200 a of FIG. 12, and content isplayed in combination with the advertisement on a second screen 1200 b.

A viewing rating of the content and information regarding whetherharmful material is included in each scene of the content are necessaryto play the advertisement. The information may be provided by thecontent provider or may be obtained based on an analysis of the contentperformed by the server or the content playing apparatus 1200. Themethod of determining whether the harmful material is included in eachscene of the content based on the analysis performed by the server orthe content playing apparatus 1200 is the same as the method ofdetermining whether the harmful material is included in each image frameof the content based on analysis of the image frames of the content.

In this case, the content playing apparatus 1200 may receive anadvertisement from a cloud server which provides the content.

The content playing apparatus 1200 may stop playing the advertisementafter the scenes including the harmful material pass.

Referring to FIG. 13, the content playing apparatus 1200 may display, onthe display apparatus 1000, a guidance message indicating that viewingis restricted, instead of playing scenes including harmful material.Content is played normally on a first screen 1300 a of FIG. 13, andcontent is played in combination with the guidance message on a secondscreen 1300 b.

A viewing rating of the content and information regarding whetherharmful material is included in each scene of the content are necessaryto play the guidance message. The information may be provided by thecontent provider or may be obtained based on an analysis of the contentperformed by the server or the content playing apparatus 1200. Themethod of determining whether the harmful material is included in eachscene of the content based on the analysis performed by the server orthe content playing apparatus 1200 is the same as the method ofdetermining whether the harmful material is included in each image frameof the content based on analysis of the image frames of the content.

In this case, the content playing apparatus 1200 may replace an entirescreen with the guidance message, and thus, the scenes including theharmful material may not be played.

The content playing apparatus 1200 may stop displaying the guidancemessage after the scenes including the harmful material pass.

The content playing apparatus 1200 may provide a different image to eachuser. In detail, the content playing apparatus 1200 displays, on thedisplay apparatus 1000, one image including two or more pieces of imageinformation on a screen and may display different images according toconditions of the users viewing the screen. For example, the users mayview different images according to locations of the users with respectto the display apparatus 1000, glasses that the users wear, viewingangles at which the users view the screen, or the like.

While the content playing apparatus 1200 may provide different images tothe respective users, the content playing apparatus 1200 may controlplaying of an image viewed by the selected user by using the methodsdescribed with reference to FIGS. 6 to 13 and may not control playing ofan image viewed by remaining users. Alternatively, the content playingapparatus 1200 may select two or more users and may control playing ofcontent such that the selected users and other users may view content.

FIG. 14 is a flowchart of a method of controlling playing of content,according to an exemplary embodiment in which a youngest user isselected based on previously stored age information of users.

Referring to FIG. 14, in operation 1401, the user recognition apparatus1100 and the content playing apparatus 1200 recognize faces of usersviewing content. For example, when the user recognition apparatus 1100captures images of the users viewing the content and transmits thecaptured images to the content playing apparatus 1200, the contentplaying apparatus 1200 may recognize the faces of the users afterportions of the faces of the users are identified from the capturedimages of the users and then facial characteristics are extracted.

In operation 1402, the content playing apparatus 1200 compares therecognized faces of the users against the previously stored ageinformation so as to determine the ages of the users. In this case, theage information of the users is in a table form in which the ages of theusers are mapped to the images of the users and may be stored in thecontent playing apparatus 1200 in advance.

If the ages of the users are determined, the content playing apparatus1200 selects the youngest user in operation 1403.

In operation 1404, the content playing apparatus 1200 checks a viewingrating of the content being played. In this case, the content playingapparatus 1200 may receive the viewing rating of the content from thecontent provider or may determine the viewing rating of the content bydirectly analyzing the content if the content provider does not providethe viewing rating. Alternatively, a cloud server analyzes the contentto determine the viewing rating, and the content playing apparatus 1200may receive the determined viewing rating from the cloud server.

In operation 1405, the content playing apparatus 1200 determines whetherthe selected user is allowed to view the content after the viewingrating of the content is compared with the age of the selected user.

If it is determined that the selected user is not allowed to view thecontent because the age of the selected user is lower than a minimum agefor viewing the content, the content playing apparatus 1200 restrictsthe viewing of the content in operation 1406. A method of restrictingthe viewing of the content which is performed by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIGS. 15 to 17 are views for explaining methods of controlling playingof content according to exemplary embodiments, the methods includingpredicting the ages of users based on user recognition and selecting theyoungest user.

Referring to FIG. 15, the users A, B, and C view the content played bythe display apparatus 1000. The display apparatus 1000 may be connectedto the user recognition apparatus 1100 for recognizing a user who viewsthe content and the content playing apparatus 1200 for controlling theplaying of the content.

The user recognition apparatus 1100 recognizes the users viewing thecontent. In this case, the user recognition apparatus 1100 is a cameraseparated from the display apparatus 1000, but may be embodied in manydifferent forms. For example, the user recognition apparatus 1100 may bea camera inserted into a frame of the display apparatus 1000.

Referring to FIG. 16, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize faces of the users viewing thecontent. The method of recognizing the faces is the same as the methoddescribed with reference to FIG. 4.

Once the faces of the users have been recognized, the content playingapparatus 1200 may predict the ages of the users by using facialrecognition results of the users. For example, the content playingapparatus 1200 may compare facial characteristics of the users, whichare determined based on the facial recognition results of the users,with previously stored facial characteristics associated with certainage groups so as to determine which age group each user belongs to andthereby predict the ages of the users. FIG. 16 shows that the contentplaying apparatus 1200 predicts the users A, B, and C are about 35 yearsold, 20 years old, and 10 years old, respectively.

Once the ages of the users have been determined, the content playingapparatus 1200 selects at least one of the users based on the predictedages according to predetermined criteria. FIG. 16 shows the selection ofa youngest user, that is, the user C, based on predicted age.

Once the youngest user has been selected, the content playing apparatus1200 controls playing of the content according to the youngest user.Therefore, the content playing apparatus 1200 may control the playing ofthe content according to the user C.

When the content playing apparatus 1200 analyzes the facial recognitionresults in order to predict the ages of the users, the predicted agesmay not match with the actual ages of the users, and thus, the contentplaying apparatus 1200 may require at least one of the users to confirmthe predicted ages.

FIG. 17 shows that the content playing apparatus 1200 requires at leastone of the users to confirm the predicted ages. Referring to FIG. 17,the content playing apparatus 1200 displays, on a first screen 1700 a ofthe display apparatus 1000, a pop-up message 1710 which requires atleast one of the users to confirm whether the predicted ages arecorrect. In FIG. 16, the user C is predicted to be about 10 years oldand is selected because the user C is determined to be the youngestuser. Therefore, the pop-up message 1710 requests for confirmationwhether the youngest user is 10 years old. When the user selects “Yes”in the pop-up message 1710, the content playing apparatus 1200determines that the selected user is 10 years old and controls theplaying of the content.

On the contrary, when the user selects “No” in the pop-up message 1710,the content playing apparatus 1200 displays a second screen 1700 b. Apop-up message 1720 which requires the user to enter the age of theyoungest user is displayed on the second screen 1700 b. When the userenters that the youngest user is 6 years old in the pop-up message 1720displayed on the second screen 1700 b, the content playing apparatus1200 determines that the selected user is 6 years old and then controlsthe playing of the content.

In this case, the content playing apparatus 1200 compares the viewingrating of the content with the age of the selected user and may controlthe playing of the content according to whether the selected user isallowed to view the content. Detailed descriptions thereof are the sameas the descriptions provided with reference to FIG. 5.

FIGS. 18 and 19 are flowcharts of methods of controlling playing ofcontent according to exemplary embodiments, the methods including usingresults of recognizing users to predict the ages of users and selectingthe youngest user.

Referring to FIG. 18, in operation 1801, the user recognition apparatus1100 and the content playing apparatus 1200 recognize faces of usersviewing the content. For example, when the user recognition apparatus1100 captures images of the users viewing the content and transmits thecaptured images to the content playing apparatus 1200, the contentplaying apparatus 1200 identifies portions of the faces of the usersfrom the captured images, and extracts facial characteristics of theusers.

In operation 1802, the content playing apparatus 1200 analyzes facialrecognition results of the users in order to predict the ages of theusers. For example, the content playing apparatus 1200 compares theextracted facial characteristics with facial characteristics associatedwith certain age groups so as to determine which age group each userbelongs to and thereby predict the ages of the users.

Once the ages of the users have been predicted, the content playingapparatus 1200 selects a user who has a minimum predicted age inoperation 1803.

In operation 1804, the content playing apparatus 1200 checks a viewingrating of the content being played. In this case, the content playingapparatus 1200 may receive the viewing rating from the content providerand may determine the viewing rating by directly analyzing the contentif the content provider does not provide the viewing rating.Alternatively, a cloud server analyzes the content to determine theviewing rating, and the content playing apparatus 1200 may receive thedetermined viewing rating from the cloud server.

In operation 1805, the content playing apparatus 1200 compares theviewing rating of the content with the predicted age of the selecteduser and determines whether the selected user is allowed to view thecontent.

If it is determined that the predicted age of the selected user is lowerthan a reference age of the content, the content playing apparatus 1200restricts viewing of the content in operation 1806. A detailed method ofrestricting viewing of the content by the content playing apparatus 1200is the same as the methods described with reference to FIGS. 6 to 13.

Compared with FIG. 18, FIG. 19 further includes an operation ofconfirming the predicted age of the selected user. Operations 1901 to1903 of FIG. 19 are the same as operations 1801 to 1803 of FIG. 18, andthus, detailed descriptions thereof will be omitted.

In operation 1904, the content playing apparatus 1200 sends a requestfor confirming the predicted age of the selected user, through a screenof the display apparatus 1000. For example, the content playingapparatus 1200 may display, on the display apparatus 1000, a pop-upmessage which requests for confirmation whether the predicted age of theselected user matches the actual age of the selected user.

If the content playing apparatus 1200 determines that the predicted ageof the selected user is correct based on a user input received inoperation 1905 with regard to the accuracy of the predicted age of theselected user, the content playing apparatus 1200 restricts viewing ofthe content according to the age of the selected user in operation 1906.

However, if the content playing apparatus 1200 determines that thepredicted age of the selected user is incorrect based on the user inputreceived in operation 1905 with regard to the accuracy of the predictedage of the selected user, the content playing apparatus 1200 receives aninput regarding the actual age of the selected user from the user. Inoperation 1906, the content playing apparatus 1200 restricts the viewingof the content according to the actual age of the selected user. Adetailed method of restricting the viewing of the content by the contentplaying apparatus 1200 is the same as the methods described withreference to FIGS. 6 to 13.

FIG. 20 is a view for explaining a method of controlling playing ofcontent, according to an exemplary embodiment, the method includingusing age information input by users when prediction of the ages of theusers fails and selecting the youngest user.

Referring to FIG. 20, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize faces of the users viewing thecontent. The method of recognizing the faces of the users is the same asthe method described with reference to FIG. 4.

Once the faces of the users have been recognized, the content playingapparatus 1200 may predict the ages of the users by using facialrecognition results of the users. For example, the content playingapparatus 1200 compares facial characteristics of the users withpreviously stored facial characteristics corresponding to age group andmay predict the ages of the users by determining which age group eachuser belongs to.

However, when the content playing apparatus 1200 predicts the ages ofthe users based on analysis of the facial recognition results of theusers, the content playing apparatus 1200 may fail to predict the agesof some users. Failing to predict the ages of some users may result frominaccurately recognizing the faces of the users, failing to match thefacial characteristics of the users with the previously stored facialcharacteristics corresponding to age group, or the like.

Referring to FIG. 20, the content playing apparatus 1200 predicts theusers A and B are about 35 years old and 20 years old, respectively, butfails to predict the age of the user C. Therefore, the content playingapparatus 1200 displays, on a screen 2000 of the display apparatus 1000,a pop-up message 2010 which requires the users to enter the age of theyoungest user. As shown in FIG. 20, if the users enters that theyoungest user is 6 years old, the content playing apparatus 1200determines that the youngest user is 6 years old and controls theplaying of the content.

In this case, the content playing apparatus 1200 compares the viewingrating of the content with the age of the selected user and may controlthe playing of the content according to whether the selected user isallowed to view the content. Detailed descriptions thereof are the sameas the descriptions provided with reference to FIG. 5.

The method of controlling the playing of the content by the contentplaying apparatus 1200 is the same as the method described withreference to FIGS. 6 to 13.

FIG. 21 is a flowchart of a method of controlling playing of content,according to an exemplary embodiment, the method including using ageinformation input by users when prediction of the ages of the usersfails and selecting the youngest user.

Referring to FIG. 21, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize faces of the users viewing thecontent. For example, when the user recognition apparatus 1100 capturesimages of the users viewing the content and transmits the capturedimages to the content playing apparatus 1200, the content playingapparatus 1200 identifies portions of the faces of the users from thecaptured images and extracts facial characteristics of the users so asto recognize the faces of the users.

In operation 2102, the content playing apparatus 1200 analyzes facialrecognition results of the users to predict the ages of the users. Forexample, the content playing apparatus 1200 compares the extractedfacial characteristics of the users with previously stored facialcharacteristics corresponding to age group and predicts the ages of theusers by determining which age group each user belongs to.

In operation 2103, the content playing apparatus 1200 determines whetherthere is any failure of predicting the ages of the users. When thecontent playing apparatus 1200 analyzes the facial recognition resultsof the users in order to predict the ages of the users, the contentplaying apparatus 1200 may fail to predict the ages of some users. Thefailure of predicting the ages of the users may result from inaccuratefacial recognition of the users, a failure to match the facialcharacteristics of the users with the previously stored facialcharacteristics corresponding to age group, or the like.

If there is no failure of predicting the ages of the users in operation2103, the content playing apparatus 1200 may select a user who has aminimum predicted age in operation 2104.

In operation 2105, the content playing apparatus 1200 restricts viewingof the content according to the age of the selected user. A detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

If there is a failure of predicting the ages of the users in operation2103, the content playing apparatus 1200 requires the users to enter theage of the youngest user and receives the entered age from the users inoperation 2106. For example, the content playing apparatus 1200 maydisplay, on a screen, a pop-up message which requires the users to enterthe age of the youngest user.

In operation 2107, the content playing apparatus 1200 determines thatthe age of the youngest user input by the users is the age of theselected user and restricts the viewing of the content. A detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIGS. 22 and 23 are views for explaining methods of controlling playingof content when another user viewing content is added and when the agesof existing users are stored in the content playing apparatus 1200,according to exemplary embodiments.

Referring to FIG. 22, while users A and B are viewing the content playedby the display apparatus 1000, a user C is added. The display apparatus1000 may be connected to the user recognition apparatus 1100 forrecognizing a user who views the content and the content playingapparatus 1200 for controlling playing of the content.

Before the user C is added, the content playing apparatus 1200 selectsthe user B who is younger than the user A and controls the playing ofthe content based on the user B. When the user C is added, the userrecognition apparatus 1100 recognizes that another user is added,captures an image of the added user, and then transmits the capturedimage to the content playing apparatus 1200.

In this case, it is assumed that the ages of the users A and B arestored in the content playing apparatus 1200. Therefore, when thecontent playing apparatus 1200 identifies the age of the user C, thecontent playing apparatus 1200 may compare the age of the user C withthe age of the user B in order to select a new user. Descriptionsthereof will be provided with reference to FIG. 23.

Referring to FIG. 23, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize a face of the user C who isnewly added. A method of recognizing the face is the same as the methoddescribed with reference to FIG. 4.

Once the face of the user C has been recognized, the content playingapparatus 1200 determines the age of the user C based on previouslystored age information. Age information of at least one user may bestored in a storage unit of the content playing apparatus 1200 inadvance. As shown in a table 2310 of FIG. 23, the age information of theusers may be in a form in which the ages of the users are respectivelymapped to images of the users.

Once the age of the user C has been determined, the content playingapparatus 1200 compares the age of the user C with the age of the userB, which is stored in the content playing apparatus 1200, and selectsthe user B again or selects user C. That is, after the age of apreviously selected user is compared with the age of a newly added user,if the age of the previously selected user is lower than the age of thenewly added user, the previously selected user is selected again, and ifthe age of the previously selected user is higher than the age of thenewly added user, the newly added user is selected. In FIG. 23, sincethe age (e.g., 6 years old) of the newly added user, that is, the userC, is lower than the age (e.g., 17 years old) of the previously selecteduser, that is, the user B, the user C is newly selected.

The content playing apparatus 1200 controls the playing of the contentaccording to the selected user, i.e., the newly selected user C. Thatis, the content playing apparatus 1200 controls the playing of thecontent according to the selected user C.

In this case, the content playing apparatus 1200 compares the viewingrating of the content with the age of the selected user and may controlthe playing of the content according to whether the selected user isallowed to view the content. Detailed descriptions thereof are the sameas the descriptions provided with reference to FIG. 5. A detailed methodof restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIG. 24 is a flowchart of a method of controlling playing of contentwhen another user is added who views the content and the ages ofexisting users are stored in the content playing apparatus 1200,according to an exemplary embodiment.

Referring to FIG. 24, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize that another user is added inoperation 2401. That is, when the user viewing the content is added, theuser recognition apparatus 1100 captures an image of the user andtransmits the captured image to the content playing apparatus 1200, andthe content playing apparatus 1200 recognizes that another user is addedwho views the content, based on the transmitted image.

In operation 2402, the content playing apparatus 1200 recognizes a faceof an added user. For example, when the user recognition apparatus 1100captures an image of the added user and transmits the captured image tothe content playing apparatus 1200, the content playing apparatus 1200identifies a portion of the face of the added user from the transmittedimage and extracts a facial characteristic of the added user in order torecognize the face of the added user.

In operation 2403, the content playing apparatus 1200 compares therecognized face of the added user against previously stored ageinformation of the users and determines the age of the added user. Inthis case, the age information of the users may be in a table form inwhich the ages of the users are respectively mapped to the images of theusers and may be stored in the content playing apparatus 1200 inadvance.

Once the age of the added user has been determined, the content playingapparatus 1200 determines whether the added user is younger than apreviously selected user in operation 2404.

If it is determined that the added user is younger than the previouslyselected user in operation 2404, the content playing apparatus 1200newly selects the added user in operation 2405, and then, operation 2406is performed.

However, if it is determined that the added user is older than thepreviously selected user in operation 2404, operation 2407 is performed,and the content playing apparatus 1200 maintains the current userselection (i.e., the previously selected user is selected again). Then,operation 2406 is performed.

In operation 2406, the content playing apparatus 1200 restricts viewingof the content according to the age of the selected user. A detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIGS. 25 and 26 are views for explaining a method of controlling playingof content when some users viewing the content leave and the ages ofexisting users are stored in the content playing apparatus 1200,according to an exemplary embodiment.

Referring to FIG. 25, while the users A, B, and C are viewing thecontent played by the display apparatus 1000, the user C leaves. Thedisplay apparatus 1000 may be connected to the user recognitionapparatus 1100 for recognizing a user who views the content and thecontent playing apparatus 1200 for controlling playing of the content.

Before the user C leaves, the content playing apparatus 1200 selects theuser C who is the youngest, from among the users A, B, and C andcontrols the playing of the content based on the user C. If the user Cleaves, the user recognition apparatus 1100 recognizes that at least oneof the users has left, captures images of the users, and transmits thecaptured images to the content playing apparatus 1200.

In this case, it is assumed that the ages of the users A, B, and C arestored in the content playing apparatus 1200. Therefore, when the user Cleaves, the content playing apparatus 1200 compares the ages of theusers A and B which are stored therein and may newly select one of theusers A and B. A detailed description thereof will be provided withreference to FIG. 26.

Referring to FIG. 26, the content playing apparatus 1200 compares theages of the users A and B who remain after the user C leaves and selectsone of the users A and B. In this case, since the ages of the users Aand B are already stored in the content playing apparatus 1200, thecontent playing apparatus 1200 may compare the ages of the users A and Bwith each other without having to repeat facial recognition thereof anddetermination of the ages thereof. In FIG. 26, since the user B, who is17 years old, is younger than the user A, who is 34 years old, thecontent playing apparatus 1200 selects the user B.

If the user is newly selected, the content playing apparatus 1200controls the playing of the content according to the selected user.Therefore, the content playing apparatus 1200 restricts the viewing ofthe content according to the age (17 years old) of the user B.

The content playing apparatus 1200 compares a viewing rating of thecontent with the age of the selected user and may control the playing ofthe content according to whether the selected user is allowed to viewthe content. Detailed descriptions thereof are the same as thedescriptions provided with reference to FIG. 5. Also, a detailed methodof restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIG. 27 is a flowchart of a method of controlling playing of contentwhen some users viewing the content leave and the ages of existing usersare stored in the content playing apparatus 1200, according to anexemplary embodiment.

Referring to FIG. 27, in operation 2701, the user recognition apparatus1100 and the content playing apparatus 1200 recognize that a userleaves. That is, when some of the users viewing the content have left,the user recognition apparatus 1100 captures images of the users andtransmits the captured images to the content playing apparatus 1200, andthe content playing apparatus 1200 recognizes that some of the usersviewing the content have left, based on the transmitted images.

In operation 2702, the content playing apparatus 1200 determines whetherthe user who left was the previously selected user.

After the determination is made, if the user who left was not thepreviously selected user, the content playing apparatus 1200 determinesthat the previously selected user is still the youngest from amongremaining users, and thus, does not change the selected user inoperation 2705.

However, if the user who left was the previously selected user, thecontent playing apparatus 1200 compares the ages of the remaining usersand selects one of the users again from among the remaining users inoperation 2703. The ages of the remaining users may be stored in thecontent playing apparatus 1200 in advance or may be identified after thecontent playing apparatus 1200 recognizes faces of the remaining usersand determines the ages thereof.

In operation 2704, the content playing apparatus 1200 restricts viewingof the content according to the age of the selected user. A detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIGS. 28 to 31 are views for explaining a method of controlling playingof content when the number of users viewing the content changes and theages of the users are not stored in the content playing apparatus 1200,according to an exemplary embodiment.

A case where another user is added who views the content will bedescribed with reference to FIGS. 28 and 29.

Referring to FIG. 28, while the users A and B are viewing the contentplayed by the display apparatus 1000, a user C is added. The displayapparatus 1000 may be connected to the user recognition apparatus 1100for recognizing a user who views the content and the content playingapparatus 1200 for controlling playing of the content.

Before the user C is added, the content playing apparatus 1200 haspreviously selected the user B and is controlling playing of the contentaccording to the user B. After the user C is added, the user recognitionapparatus 1100 recognizes that a new user has been added, captures animage of the added user, and transmits the captured image to the contentplaying apparatus 1200.

It is assumed that the ages of the users A and B are not stored in thecontent playing apparatus 1200. Therefore, the content playing apparatus1200 identifies the ages of the users A and B who are existing users andthe age of the user C who is newly added and compares the ages of theusers A, B, and C with each other so as to select one of the users A, B,and C. Detailed descriptions thereof will be provided with reference toFIG. 29.

Referring to FIG. 29, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize faces of users A and B who areexisting users and a face of the user C who is newly added. A method ofrecognizing the faces of the users A, B, and C is the same as the methoddescribed with reference to FIG. 4.

Once the faces of the users A, B, and C have been recognized, thecontent playing apparatus 1200 determines the ages of the users A, B,and C based on previously stored age information of the users A, B, andC. Age information of at least one of the users A, B, and C may bestored in the storage unit of the content playing apparatus 1200. Theage information may be in a form in which the ages of the users A, B,and C are respectively mapped to images thereof, according to a table2910 of FIG. 29. Referring to FIG. 29, the content playing apparatus1200 may determine that the users A, B, and C are 34 years old, 17 yearsold, and 6 years old, respectively.

Once the ages of the users A, B, and C have been determined, the contentplaying apparatus 1200 selects the youngest user from among the users A,B, and C. In FIG. 29, since the user C is the youngest, the contentplaying apparatus 1200 selects the user C.

After the youngest user is selected, the content playing apparatus 1200controls the playing of the content according to the selected user.Therefore, the content playing apparatus 1200 restricts viewing of thecontent according to the age (6 years old) of the user C.

In this case, the content playing apparatus 1200 compares a viewingrating of the content with the age of the selected user and may controlthe playing of the content according to whether the selected user isallowed to view the content. Detailed descriptions thereof are the sameas the descriptions provided with reference to FIG. 5. Also, a detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

A case where a user who is viewing content leaves will be described withreference to FIGS. 30 and 31.

Referring to FIG. 30, while the users A, B, and C are viewing thecontent played by the display apparatus 1000, the user C leaves. Thedisplay apparatus 1000 may be connected to the user recognitionapparatus 1100 for recognizing a user who views the content and thecontent playing apparatus 1200 for controlling playing of the content.

Before the user C leaves, the content playing apparatus 1200 selects theuser C who is the youngest, from among the users A, B, and C andcontrols the playing of the content based on the user C. When the user Cleaves, the user recognition apparatus 1100 recognizes that at least oneof the users has left, captures images of the users, and transmits thecaptured images to the content playing apparatus 1200.

In this case, it is assumed that the ages of the users A and B are notstored in the content playing apparatus 1200. Therefore, when the user Cleaves, the content playing apparatus 1200 may identify the ages of theusers A and B who remain after the user C leaves and compare them inorder to select one of the users A and B. A detailed description thereofwill be provided with reference to FIG. 31.

Referring to FIG. 31, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize faces of users A and B whoremain. A method of recognizing the faces of the users A and B is thesame as the method described with reference to FIG. 4.

Once the faces of the users A and B have been recognized, the contentplaying apparatus 1200 determines the ages of the users A and B based onpreviously stored age information of the users A and B. Age informationof at least one of the users A and B may be stored in the storage unitof the content playing apparatus 1200. The age information may be in aform in which the ages of the users A and B are respectively mapped toimages thereof, according to a table 3110 of FIG. 31.

The content playing apparatus 1200 compares the recognized faces of theusers A and B against the images thereof which are stored in the table3110 so as to determine the ages of the users A and B. Referring to thetable 3110 of FIG. 31, the content playing apparatus 1200 may determinethat the users A and B are 34 years old and 17 years old, respectively.

Once the ages of the users A and B have been determined, the contentplaying apparatus 1200 selects the youngest user among the users A andB. Referring to FIG. 31, the user B is the youngest, and thus, thecontent playing apparatus 1200 selects the user B.

After the selection is completed, the content playing apparatus 1200controls the playing of the content according to the selected user.Therefore, the content playing apparatus 1200 restricts viewing of thecontent according to the age (17 years old) of the user B.

In this case, the content playing apparatus 1200 compares a viewingrating of the content with the age of the selected user and may controlthe playing of the content according to whether the selected user isallowed to view the content. Detailed descriptions thereof are the sameas the descriptions provided with reference to FIG. 5. Also, a detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIG. 32 is a flowchart of a method of controlling playing of contentwhen the number of users viewing the content changes and the ages of theusers are not stored in the content playing apparatus 1200, according toan exemplary embodiment.

Referring to FIG. 32, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize that the number of userschanges, in operation 3201. That is, when the number of users viewingthe content changes, the user recognition apparatus 1100 captures imagesof the users and transmits the captured images to the content playingapparatus 1200, and the content playing apparatus 1200 recognizes thatanother user viewing the content is added or some of the users viewingthe content have left, based on the transmitted images.

In operation 3202, the user recognition apparatus 1100 and the contentplaying apparatus 1200 recognize faces of the users. For example, theuser recognition apparatus 1100 captures an image of the added user andtransmits the captured image to the content playing apparatus 1200, andthe content playing apparatus 1200 recognizes a portion of the face ofthe added user from the transmitted image and extracts a facialcharacteristic of the user so as to recognize the face of the user.

In operation 3203, the content playing apparatus 1200 compares therecognized faces of the users against previously stored age informationof the users to determine the ages of the users. In this case, the ageinformation of the users is in a table form in which the ages of theusers are respectively mapped to the images of the users and may bestored in the content playing apparatus 1200 in advance.

If the ages of the users are determined, the content playing apparatus1200 selects the youngest user in operation 3204.

In operation 3205, the content playing apparatus 1200 restricts viewingof the content according to the age of the selected user. A detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIGS. 33 and 34 are views of explaining a method of controlling playingof content when conversations between users are analyzed and predictingthe addition of a user, according to an exemplary embodiment.

Referring to FIG. 33, users A and B view the content played by thedisplay apparatus 1000, but a user C is not viewing the content. Theuser recognition apparatus 1100 has recognized that only the users A andB are viewing the content, and the content playing apparatus 1200 hasselected the user B, who is the youngest, and is controlling the playingof the content according to the user B.

As shown in FIG. 33, while the users A and B are viewing the content,the user B suggests for the user C to view the content. In this case, itis assumed that the user recognition apparatus 1100 has a function forrecognizing voices. For example, the user recognition apparatus 1100 hasa microphone which recognizes voices. The content playing apparatus 1200recognizes and analyzes the voice of the user B which is received fromthe user recognition apparatus 1100 and may predict that the user C willbe added as a user. The content playing apparatus 1200 controls theplaying of the content according to the above prediction. Detailedprocesses of predicting addition of another user and controlling theplaying of the content will be described with reference to FIG. 34.

Referring to FIG. 34, the content playing apparatus 1200 analyzes aconversation including a suggestion by the user B for the user C to viewthe content and predicts that the user C will be added. After theprediction is completed, the content playing apparatus 1200 determinesthe age of the user C to be added.

The method of predicting the age of the user C, the method performed bythe content playing apparatus 1200, is as follows. Since the user C hasnot yet been added as a user, the user recognition apparatus 1100 maynot recognize a face of the user C. However, since the content playingapparatus 1200 identifies the name of the user C through voicerecognition, the content playing apparatus 1200 may determine the age ofthe user C by comparing the name of the user C against previously storedage information of users. The age information of the users may be in aform in which the ages of the users are respectively mapped to the namesof the users as shown in a table 3410 of FIG. 34. The content playingapparatus 1200 compares the recognized name of the user C with the table3410 of FIG. 34 containing the age information of the users and maydetermine that the user C is 6 years old.

Once the age of the user C has been determined, the content playingapparatus 1200 compares the age of the previously selected user, thatis, the user B, with the age of the user C who is predicted to be addedand may select one of the users B and C. As a result, since the user Cis younger than the user B, the user C is selected.

After the selection is made, the content playing apparatus 1200 controlsthe playing of the content according to the selected user. Therefore,the content playing apparatus 1200 controls the playing of the contentaccording to the age (6 years old) of the user C.

In this case, the content playing apparatus 1200 compares a viewingrating of the content with the age of the selected user and may controlthe playing of the content according to whether the selected user isallowed to view the content. Detailed descriptions thereof are the sameas the descriptions provided with reference to FIG. 5. Also, a detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

FIG. 35 is a flowchart of a method of controlling playing of contentwhen conversations between users are analyzed and predicting theaddition of a user, according to an exemplary embodiment.

Referring to FIG. 35, in operation 3501, the user recognition apparatus1100 and the content playing apparatus 1200 recognize voices of theusers. That is, the user recognition apparatus 1100 receivesconversations between the users and transmits the received conversationsto the content playing apparatus 1200.

In operation 3502, the content playing apparatus 1200 analyzes therecognized voices of the users and predicts that another user is to beadded. For example, if the conversations between the users include asuggestion for a new user to view the content, the content playingapparatus 1200 predicts that the new user will be added.

In operation 3503, the content playing apparatus 1200 determines the ageof the user who is predicted to be added based on previously stored ageinformation of users. In this case, since the user predicted to be addedis not yet present, the content playing apparatus 1200 is unable torecognize a face of the user predicted to be added. Therefore, thecontent playing apparatus 1200 compares the name of the user predictedto be added, which has been identified through voice recognition,against the age information of the users, and then, determines the ageof the user. In this case, the age information may be in a form in whichthe ages of the users are respectively mapped to the names of the users.

In operation 3504, the content playing apparatus 1200 determines whetherthe user who is predicted to be added is younger than a previouslyselected user. If the user who is predicted to be added is younger thanthe previously selected user, the content playing apparatus 1200 newlyselects the user who is predicted to be added in operation 3505.However, if the user who is predicted to be added is older than thepreviously selected user, operation 3507 is performed, and the contentplaying apparatus 1200 maintains the current user selection.

If the new selection is made, the content playing apparatus 1200restricts viewing of the content according to the age of the selecteduser in operation 3506. A detailed method of restricting the viewing ofthe content by the content playing apparatus 1200 is the same as themethods described with reference to FIGS. 6 to 13.

FIGS. 36 and 37 are views for explaining a method of recognizing userswhen content being played changes and of controlling playing of content,according to an exemplary embodiment.

Referring to FIG. 36, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize users viewing first content3600 a and select a user C who is the youngest. The content playingapparatus 1200 controls playing of the first content 3600 a according tothe age (6 years old) of the selected user, that is, the user C.

If content played by the content playing apparatus 1200 changes from thefirst content 3600 a to second content 3600 b, the content playingapparatus 1200 recognizes the users and selects one of the users again.That is, the content playing apparatus 1200 recognizes users A and Bviewing the second content 3600 b, determines the ages of the users Aand B, and selects the user B who is the youngest.

Referring to FIG. 37, the content playing apparatus 1200 compares theage of the user B who is newly selected against a viewing rating of thesecond content 3600 b and restricts viewing of the content. The contentplaying apparatus 1200 receives the viewing rating (a 15+ rating) of thesecond content 3600 b from a content provider and compares the receivedviewing rating with the age (17 years old) of the selected user, thatis, the user B. Since the age (17 years old) of the selected user ishigher than a reference age (15 years old) of the viewing rating of thesecond content 3600 b, the content playing apparatus 1200 determinesthat the user B is allowed to view the second content 3600 b. Therefore,the content playing apparatus 1200 plays the second content 3600 bwithout any restriction.

FIG. 38 is a flowchart of a method of recognizing users when contentbeing played changes and of controlling playing of content, according toan exemplary embodiment.

Referring to FIG. 38, in operation 3801, the user recognition apparatus1100 and the content playing apparatus 1200 recognize users viewing thecontent and select one of the users. A method of recognizing the usersand selecting one of the users based on the ages thereof is the same asthe method described with reference to FIG. 4.

In operation 3802, the content playing apparatus 1200 restricts viewingof the content according to the age of the selected user. A detailedmethod of restricting the viewing of the content by the content playingapparatus 1200 is the same as the methods described with reference toFIGS. 6 to 13.

In operation 3803, the content playing apparatus 1200 determines whethercontent being played changes.

If it is determined that the content being played changes, the contentplaying apparatus 1200 recognizes the users and selects one of the usersagain in operation 3804. A method of recognizing the users and selectingone of the users is the same as the method described in operation 3801.

If the new selection is made, the content playing apparatus 1200restricts viewing of the content according to the age of the selecteduser in operation 3805. A detailed method of restricting the viewing ofthe content by the content playing apparatus 1200 is the same as themethods described with reference to FIGS. 6 to 13.

FIGS. 39 and 40 are views for explaining methods of periodicallyrecognizing users and controlling playing of content, according toexemplary embodiments.

Referring to FIG. 39, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize users viewing the content andselect the user C who is the youngest. The content playing apparatus1200 controls the playing of the content according to the age (6 yearsold) of the selected user, that is, the user C.

After a predetermined amount of time has passed, the user recognitionapparatus 1100 and the content playing apparatus 1200 recognize theusers and select one of the users again. That is, the user recognitionapparatus 1100 and the content playing apparatus 1200 periodicallyrecognize the users and select one of the users. In this case, a cyclein which the users are recognized and one of the users is selected maybe arbitrarily set. For example, a user may set the user recognitionapparatus 1100 and the content playing apparatus 1200 to recognize theusers and select one of the users at 10-minute intervals. In FIG. 39,the user recognition apparatus 1100 and the content playing apparatus1200 recognize the users A and B viewing the content after apredetermined amount of time has passed and then select the user B whois the youngest.

Referring to FIG. 40, the content playing apparatus 1200 compares theage of the user B who is newly selected against a viewing rating of thecontent and restricts viewing of the content. The content playingapparatus 1200 receives the viewing rating (a teenager restrictedrating) of the content from a content provider and compares the receivedviewing rating with the age (17 years old) of the user B who is newlyselected. Since the age (17 years old) of the selected user is lowerthan a reference age (19 years old) of viewing rating, the contentplaying apparatus 1200 determines that the selected user is not allowedto view the content. Therefore, the content playing apparatus 1200restricts viewing of the content. A detailed method of restricting theviewing of the content by the content playing apparatus 1200 is the sameas the methods described with reference to FIGS. 6 to 13.

FIG. 41 is a flowchart of a method of periodically recognizing users andcontrolling playing of content, according to exemplary embodiments.

Referring to FIG. 41, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize users viewing the content andselect any one of the users. A method of recognizing the users andselecting one of the users based on the ages thereof is the same as themethod described with reference to FIG. 4.

In operation 4102, the content playing apparatus 1200 restricts theviewing of the content according to the age of the selected user. Adetailed method of restricting the viewing of the content by the contentplaying apparatus 1200 is the same as the methods described withreference to FIGS. 6 to 13.

In operation 4103, the content playing apparatus 1200 determines whethera predetermined amount of time has passed.

After the determination is made, the user recognition apparatus 1100 andthe content playing apparatus 1200 recognize the users and select one ofthe users again. In this case, a method of recognizing the users andselecting one of the users which is performed by the user recognitionapparatus 1100 and the content playing apparatus 1200 is the same as themethod described in operation 4101.

If the new selection is made, the content playing apparatus 1200restricts viewing of the content according to the age of the selecteduser in operation 4105. A detailed method of restricting the viewing ofthe content by the content playing apparatus 1200 is the same as themethods described with reference to FIGS. 6 to 13.

FIG. 42A is a view of explaining a method of restricting channelssearchable by a user according to the age of a selected user.

Referring to FIG. 42A, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize users viewing the content andselect the user C who is the youngest. The content playing apparatus1200 controls the playing of the content according to the age (6 yearsold) of the selected user, that is, the user C. In addition, when asearch request is input for searching for channels, the content playingapparatus 1200 may restrict search to certain channels according to theage (6 years old) of the selected user, that is, the user C.

For example, if the search request is received while a first screen 4200a is being displayed on the display apparatus 1000, the content playingapparatus 1200 may restrict the search to certain channels according tothe age (6 years old) of the selected user, that is, the user C. Thatis, the content playing apparatus 1200 displays, on a screen of thedisplay apparatus 1000, a search result including channels other thanchannels inappropriate for the selected user. Referring to FIG. 42A, thecontent playing apparatus 1200 displays a search result 4210, from whichrestricted channels have been filtered out, on a second screen 4200 b.

FIG. 42B is a flowchart of a method of restricting a search of channelsaccording to a user selected based on ages, according to an exemplaryembodiment.

Referring to FIG. 42B, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize faces of users viewing thecontent in operation 4201. For example, the user recognition apparatus1100 captures images of the users viewing the content and transmits thecaptured images to the content playing apparatus 1200, and the contentplaying apparatus 1200 identifies portions of the faces of the usersfrom the transmitted images and extracts characteristics of the usersfrom the captured images.

In operation 4202, the content playing apparatus 1200 compares therecognized faces of the users against previously stored age informationof the users so as to determine the ages of the users. In this case, theage information of the users may be in a table form in which the ages ofthe users are respectively mapped to the images of the users and may bestored in the content playing apparatus 1200 in advance.

A method of recognizing the users and selecting one of the users basedon the ages thereof is the same as the method described with referenceto FIG. 4.

Once the ages of the users have been determined, the content playingapparatus 1200 selects the youngest user in operation 4203.

In operation 4204, the content playing apparatus 1200 receives a requestfor searching for channels and restricts channels searchable by theselected user, according to the age of the selected user. That is, thecontent playing apparatus 1200 displays, on a screen of the displayapparatus 1000, a search result including channels other than channelsinappropriate for the selected user.

FIG. 43A is a view of a method of restricting playing of contentaccording to a user selected based on ages when a channel changes,according to an exemplary embodiment.

Referring to FIG. 43A, the user recognition apparatus 1100 and thecontent playing apparatus 1200 recognize users viewing the content andselect a user C who is the youngest. The content playing apparatus 1200controls playing of the content when a channel changes according to theage (6 years old) of the selected user, that is, the user C.

In detail, when the channel displayed on the display apparatus 1000changes, the content playing apparatus 1200 determines whether contentthat the user C is not allowed to view is being played on the changedchannel. If the user C is not allowed to view the content beingdisplayed on the changed channel, the content playing apparatus 1200 mayrestrict viewing of the content or may change the channel to anotherchannel on which content appropriate for the user C is being played.

According to FIG. 43A, when a channel on which a first screen 4300 athat is allowed to the user C is being played changes to a channel onwhich a second screen 4300 b that the user C is not allowed to view isbeing played, the content playing apparatus 1200 may pixelate a portionof the second screen 4300 b in order to restrict the viewing of thecontent, as illustrated in FIG. 43A. A detailed method of restrictingthe viewing of the content in the content playing apparatus 1200 is thesame as the methods described with reference to FIGS. 6 to 13.

Alternatively, the content playing apparatus 1200 may skip the channelon which the content that the user C is not allowed to view is beingplayed and may change the channel to another channel on which content,for example, a third screen 4300 c, which is allowed to the user C isbeing played.

FIG. 43B is a flowchart of a method of restricting playing of contentaccording to a user selected based on ages when a channel changes,according to an exemplary embodiment.

Referring to FIG. 43B, in operation 4301, the user recognition apparatus1100 and the content playing apparatus 1200 recognize faces of usersviewing the content. For example, the user recognition apparatus 1100captures images of the users viewing the content and transmits thecaptured images to the content playing apparatus 1200, and the contentplaying apparatus 1200 may identify portions of the faces of the usersfrom the captured images of the users and then extract facialcharacteristics.

In operation 4302, the content playing apparatus 1200 compares therecognized faces of the users against the previously stored ageinformation so as to determine the ages of the users. In this case, theage information of the users is in a table form in which the ages of theusers are mapped to the images of the users and may be stored in thecontent playing apparatus 1200 in advance.

The method of recognizing the faces of the users viewing the content anddetermining the ages of the users is the same as the method describedwith reference to FIG. 4.

If the ages of the users are determined, the content playing apparatus1200 selects the youngest user in operation 4303.

When a channel of the display apparatus changes in operation 4304, thecontent playing apparatus 1200 determines whether content that is notallowed to the selected user is being played on the changed channel inoperation 4305.

After the determination is made, if the content that is not allowed tothe selected user is being played on the changed channel, the contentplaying apparatus 1200 may restrict viewing of the content or change thechannel to another channel on which content allowed to the selected useris being played, in operation 4306.

FIGS. 44 and 45 are views for explaining a method of displaying apreferred channel according to a user selected based on an actionrecognition result, according to an exemplary embodiment.

Referring to FIG. 44, users A and B view content played by the displayapparatus 1000. In the present exemplary embodiment, the userrecognition apparatus 1100 and the content playing apparatus 1200recognize actions of the users and select a user who performs a certainaction. In particular, the content playing apparatus 1200 selects theuser A based on commands input by the user A via a remote control 4410,and channels of the display apparatus 1000 are manipulated by the user Aaccording to a preference of the user A. The content playing apparatus1200 may select a user based on various actions.

If the user is selected, a feedback based on the preference of theselected user is provided. Referring to FIG. 45, a preferred channellist 4510 with regard to each user is stored in the content playingapparatus 1200 in advance. Preferred channels of the users may berespectively mapped to the images of the users and may be stored in thepreferred channel list 4510. In this case, as shown in FIG. 45,categories of channels may be stored or the preferred channels may berespectively stored in the preferred channel list 4510. Since the user Ais selected in FIG. 44, the content playing apparatus 1200 confirms thatthe preferred channels of the user A are sports, movies, and newschannels by referring to the preferred channel list 4510. The contentplaying apparatus 1200 displays, on a screen, a preferred channel list4520 of the user A.

FIG. 46 is a flowchart of a method of displaying preferred channelsaccording to a user selected based on an action recognition result,according to an exemplary embodiment.

Referring to FIG. 46, in operation 4601, the user recognition apparatus1100 and the content playing apparatus 1200 recognize actions of usersviewing content by the content playing apparatus 1200. In this case, thecontent playing apparatus 1200 may recognize actions as well as faces ofthe users in order to identify each user.

In operation 4602, the content playing apparatus 1200 selects a user whoperforms a predetermined action. For example, the content playingapparatus 1200 may select a user inputting commands via a remotecontrol. The content playing apparatus 1200 may select a user based onvarious actions.

In operation 4603, the content playing apparatus 1200 checkspreviously-stored preferred channels of the selected user. A preferredchannel list with regard to each user may be stored in the contentplaying apparatus 1200 in advance.

In operation 4604, the content playing apparatus 1200 displays apreferred channel list of the selected user on a screen.

FIG. 47 is a view for explaining a method of determining and displayingpreferred channels based on channel histories of users, according to anexemplary embodiment.

As shown in FIG. 44, it is assumed that the user A inputting commandsvia the remote control 4410 is selected. In FIG. 45, a preferred channellist with regard to each user is stored in the content playing apparatus1200 in advance, and thus, the content playing apparatus 1200 checkspreferred channels of the selected user based on the stored preferredchannel list. However, in the present exemplary embodiment, a channelhistory of each user is analyzed to determine preferred channels of eachuser.

Referring to FIG. 47, the content playing apparatus 1200 analyzes achannel history 4710 of each user. In this case, a list of viewedchannels of each user is mapped to an image of each user and is storedin the channel history 4710. The viewed channels stored in the channelhistory 4710 may be channels viewed by each user for a predeterminedtime or the predetermined number of channels viewed by each user. Amethod of forming a channel history may vary. For example, a method offorming a channel history may be formed by using a list of channelsviewed by each user at predetermined intervals.

As a result of analyzing the channel history 4710, the content playingapparatus 1200 determines that ESPN and BBC are preferred channels ofthe user A because ESPN and BBC have been viewed by the user A at leasta certain number of times. The content playing apparatus 1200 displays apreferred channel list 4720 of the user A on a screen.

FIG. 48 is a flowchart of a method of determining and displayingpreferred channels based on channel histories of users, according to anexemplary embodiment.

Referring to FIG. 48, in operation 4801, the user recognition apparatus1100 and the content playing apparatus 1200 recognize actions of usersviewing the content. In this case, the user recognition apparatus 1100and the content playing apparatus 1200 may recognize the actions as wellas faces of the users in order to identify each user.

In operation 4802, the content playing apparatus 1200 selects a user whoperforms predetermined actions. For example, the content playingapparatus 1200 may select a user inputting commands via a remotecontrol. The content playing apparatus 1200 may select a user based onvarious actions.

In operation 4803, the content playing apparatus 1200 analyzes a channelhistory of the selected user and determines preferred channels of theselected user. In detail, the content playing apparatus 1200 analyzes alist of channels viewed by the selected user and may determine thatchannels, which are viewed by the selected user a certain number oftimes, are the preferred channels of the selected user.

In operation 4804, the content playing apparatus 1200 displays thepreferred channels of the selected user on a screen.

FIG. 49 is a view for explaining a method of determining and displayingpreferred content based on a channel history of each user, according toan exemplary embodiment.

As shown in FIG. 44, it is assumed that the user inputting commands viathe remote control 4410 is selected. FIG. 47 shows that the contentplaying apparatus 1200 analyzes a list of channels viewed by the usersand determines and displays the preferred channels of the selected user.However, in the present exemplary embodiment, the content playingapparatus 1200 analyzes a list of content viewed by the users in orderto analyze a genre of preferred content of the selected user anddisplays, on the display apparatus 1000, another list for recommendingother pieces of content included in the preferred genre.

Referring to FIG. 49, the content playing apparatus 1200 analyzes aviewed content list 4910 for each user. In this case, lists of contentviewed by the users are respectively mapped to images of the users andare stored in the viewed content lists 4910. The viewed content storedin the viewed content lists 4910 may be content viewed by the users fora predetermined amount of time or a predetermined number of pieces ofcontent viewed by the users. A method of forming a viewed content listmay vary, for example, a method of using a list of pieces of contentviewed by each user in each time.

The content playing apparatus 1200 determines that a preferred genre ofthe user A is action based on an analysis of the viewed content list4910 of the user A. The content playing apparatus 1200 searches forother pieces of content included in the same genre and displays arecommendation list 4920 on the screen.

FIG. 50 is a flowchart of a method of determining and displayingpreferred content based on channel histories of users, according to anexemplary embodiment.

Referring to FIG. 50, in operation 5001, the user recognition apparatus1100 and the content playing apparatus 1200 recognize actions of usersviewing the content. In this case, the user recognition apparatus 1100and the content playing apparatus 1200 may recognize the actions as wellas faces of the users in order to identify each user.

In operation 5002, the content playing apparatus 1200 selects a user whoperforms predetermined actions. For example, the content playingapparatus 1200 may select a user inputting commands via a remotecontrol. The content playing apparatus 1200 may select a user based onvarious actions.

In operation 5003, the content playing apparatus 1200 determines apreferred genre of the selected user based on analysis of a channelhistory of the selected user. In detail, the content playing apparatus1200 analyzes a list of pieces of content viewed by the selected userand determines a genre of preferred content of the selected user.

In operation 5004, the content playing apparatus 1200 displays arecommendation list of content included in the preferred genre of theselected user.

FIG. 51 is a block diagram of a structure of a display apparatusconfigured to support a content playing control function, according toan exemplary embodiment.

As described above, the above-described processes of controlling theplaying of the content may be performed by the content playing apparatusseparate from the display apparatus, but all processes may be performedby the display apparatus. In this case, the playing of the content maybe controlled by a single apparatus.

Referring to FIG. 51, the display apparatus 1000 may include the userrecognition apparatus 1100, a user interface 5160, a communication unit5130, a storage unit 5140, an output unit 5170, and a controller 5150.

The user recognition apparatus 1100 may recognize users viewing thecontent. In this case, recognition means identifying the existence of anobject or extracting and analyzing characteristics of the object. Theuser recognition apparatus 1100 may include a detection unit (not shown)for detecting images or voices of users and an analysis unit (not shown)for analyzing the detected images or voices. The detection unit may be acamera, a micro phone, etc. included in the display apparatus 1000, andthe analysis unit may be a processor or the like configured to analyzeimages or voices.

The user interface 5160 is configured to receive various user inputs andmay be a manipulation button, a remote control, or the like.

The communication unit 5130 is configured to receive/transmit datafrom/to a server and may receive content from an external server, etc.via wired or wireless communication.

The storage unit 5140 stores data and may store content transmitted byan external device, age information of users, preferred channel lists ofthe users, or the like.

The output unit 5170 may include an image output unit 5172 and a voiceoutput unit 5175. Images and voices of content played by the displayapparatus 1000 are respectively output through the image output unit5172 and the voice output unit 5175.

The controller 5150 controls overall operations of components includedin the display apparatus 1000. The controller 5150 may be a microprocessor, etc. The controller 5150 may include a recognition manager5152 and a restriction manager 5155.

The recognition manager 5155 may perform user recognition by usingcaptured images or voices of the users which are received from the userrecognition apparatus 1100 and may select at least one of the usersaccording to predetermined criteria. In detail, the recognition manager5152 recognizes portions corresponding to faces of the users from thecaptured images, analyzes symmetric facial structures, appearances,hair, colors of the eyes, movements of facial muscle, etc. of the users,and extracts facial characteristics of the users. Then, the recognitionmanager 5152 may compare the extracted facial characteristics with ageinformation of the users which is stored in the storage unit 5140 andmay determine the ages of the users. In this case, the age informationof the users may be in a form in which the ages of the users arerespectively mapped to the images of the users.

Alternatively, the recognition manager 5152 may analyze body shapes ofthe users from the images transmitted by the user recognition apparatus1100 or may analyze voices of the users which are transmitted by theuser recognition apparatus 1100 in order to compare the analyzed voiceswith the age information and determine the ages of the users. In thiscase, the age information of the users may be in a form in which theages of the users are respectively mapped to the body shapes or voicesof the users.

Alternatively, the recognition manager 5152 may analyze the images orvoices of the users which are transmitted by the user recognitionapparatus 1100 and compare the analyzed images or voices with facialcharacteristics, body shapes, or voices of age groups, which are storedin the storage unit 5140 in advance, so as to determine the ages of theusers.

Alternatively, the recognition manager 5152 may analyze actions of theusers from the images transmitted by the user recognition apparatus1100.

Alternatively, the recognition manager 5152 may recognize a change ofthe number of users viewing the content and may predict that anotheruser is to be added based on analysis of conversations between theusers.

Meanwhile, the recognition manager 5152 may select a user according tothe predetermined criteria, for example, the youngest user or a user whoperforms a certain action. The recognition manager 5152 may select auser according to various criteria other than the above criteria.

The restriction manager 5155 controls playing of the content accordingto the selected user. For example, when the youngest user is selected,the restriction manager 5155 compares the age of the selected useragainst a viewing rating of the content and may control playing ofpieces of the content that the selected user is not able to view. Inthis case, the restriction manager 5155 may receive the viewing ratingfrom a content provider, but may determine the viewing rating based onanalysis of the content if the viewing rating is not provided.

Components of the display apparatus 1000 may perform the operations forimplementing the methods of controlling the playing of the content,which are described with reference to FIGS. 1 to 50, even through someof the operations are not described with reference to FIG. 51.

The embodiment in which the processes of controlling the playing of thecontent, which are directly performed by the display apparatus 1000, forexample, a TV, having a display function, has been described withreference to FIG. 51. However, processes of recognizing the users,determining whether to restrict viewing the content, restricting theviewing of the content, etc. may be performed by a separate device or anexternal server.

Hereinafter, embodiments in which processes used to control the playingof the content are performed by a device, a server, or the like, whichis connected to the display apparatus will be described with referenceto FIGS. 52 to 58.

FIG. 52 is a view of a system for controlling playing of content,according to an exemplary embodiment. Referring to FIG. 52, the systemmay include the display apparatus 1000, the user recognition apparatus1100, the content playing apparatus 1200, and a server 1300. A detailedstructure and operation of each component of the system will bedescribed with reference to FIGS. 53 and 54.

FIG. 53 is a view of detailed structures of the devices included in thesystem of FIG. 52, according to an exemplary embodiment. While devicesnecessary to perform the present exemplary embodiment are illustrated inFIG. 53, the system may further include common devices other than theillustrated devices.

In the system of FIG. 53, the content playing apparatus 1200 performsall processes such as processes of recognizing users, determiningwhether to restrict content, and restricting the content. In this case,the server 1300 provides the content playing apparatus 1200 with contentto be played, and the user recognition apparatus 1100 transmits capturedimages of the users to the content playing apparatus 1200.

Referring to FIG. 53, the display apparatus 1000 may include thecommunication unit 1040 and the output unit 1030. The output unit 1030may include the image output unit 1031 and the voice output unit 1032.The image output unit 1031 may be, for example, a liquid crystal display(LCD), an organic light-emitting diode (OLED) display having a screenthat displays content. The voice output unit 1032 may be, for example, aspeaker. The display apparatus 1000 receives, from the content playingapparatus 1200, data used to play the content via the communication unit1040 and may output the received data to the output unit 1030 as imagesor voices.

The user recognition apparatus 1100 may include a camera 1111 forcapturing images and a communication unit 1120 for transmitting thecaptured images. Also, the user recognition apparatus 1100 may furtherinclude a voice detection unit (not shown) for detecting voices of theusers. The user recognition apparatus 1100 may be embodied as anapparatus separated from the display apparatus 1000 or a camerainstalled in a frame of the display apparatus 1000. Detaileddescriptions thereof will be provided below with reference to FIGS. 55and 56.

The content playing apparatus 1200 may include a communication unit1210, a controller 1220, and a storage unit 1230, and the controller1220 may include a recognition manager 1221 and a restriction manager1222.

The communication unit 1210 receives the images from the userrecognition apparatus 1100 and transmits the received images to thecontroller 1220, and also receives content from the server 1300 andtransmits the received content to the controller 1220. The controller1220 may perform processes of recognizing the users, determining whetherto restrict the content, and restricting the content. The recognitionmanager 1221 receives, from the user recognition apparatus 1100, imagesof the users viewing the content and may recognize faces, body shapes,or the like, of the users from the received images. Alternatively, therecognition manager 1221 may analyze voices of the users received fromthe user recognition apparatus 1100.

When the users are recognized, the recognition manager 1221 may selectat least one of the users according to predetermined criteria. Forexample, the recognition manager 1221 may select the youngest user or auser who performs a certain action.

When the selection is completed by the recognition manager 1221, therestriction manager 1222 controls playing of the content according tothe selected user. For example, the restriction manager 1222 comparesthe age of the selected user against a viewing rating of the content inorder to determine whether the selected user is allowed to view thecontent. If the selected user is not allowed to view the content, therestriction manager 1222 may stop playing of the content or reprocessthe content and transmits the reprocessed content to the displayapparatus 1000.

The controller 1220 may use information, which is necessary to performthe processes of recognizing the users, determining whether to restrictthe content, restricting the content, etc., by accessing the storageunit 1230. User information required to recognize the users and select areference user as well as content-related information required todetermine whether to restrict the content may be stored in the storageunit 1230.

The server 1300 may include a communication unit 1330, a controller1320, and a storage unit 1310. The communication unit 1330 of the server1300 may be connected to the communication unit 1210 of the contentplaying apparatus 1200 via a network such as Internet.

When a content request is received from the content playing apparatus1200, the controller 1320 of the server 1300 extracts a piece of contentwhich is requested from among pieces of content and transmits theextracted piece to the content playing apparatus 1200.

The content playing apparatus 1200 transmits content playing data thatis controlled to the communication unit 1040 of the display apparatus1000 via the communication unit 1210, and the display apparatus 1000converts the received content playing data and may output images andvoices to the output unit 1030.

FIG. 54 is a view of detailed structures of the devices included in thesystem of FIG. 52, according to another exemplary embodiment. Whiledevices necessary to perform the present exemplary embodiment areillustrated in FIG. 54, the system may further include common devicesother than the illustrated devices.

In the system of FIG. 54, the content playing apparatus 1200 and theserver 1300 perform processes for controlling playing of content. Indetail, the content playing apparatus 1200 recognizes users, and theserver 1300 determines whether to restrict the content based on arecognition result and restricts the content. In this case, the userrecognition apparatus 1100 transmits captured images of the users to thecontent playing apparatus 1200.

Referring to FIG. 54, the display apparatus 1000 may include thecommunication unit 1040 and the output unit 1030, and the output unit1030 may include the image output unit 1031 and the voice output unit1032. The image output unit 1031 may be, for example, an LCD, an OLEDdisplay having a screen that displays content. The voice output unit1032 may be, for example, a speaker. The display apparatus 1000receives, from the content playing apparatus 1200, data used to play thecontent via the communication unit 1040 and may output the received datato the output unit 1030 as images or voices.

The user recognition apparatus 1100 may include the camera 1111 forcapturing images and the communication unit 1120 for transmitting thecaptured images. Also, the user recognition apparatus 1100 may furtherinclude the voice detection unit (not shown) for detecting voices of theusers. The user recognition apparatus 1100 may be embodied as anapparatus separated from the display apparatus 1000 or a camerainstalled in a frame of the display apparatus 1000. Detaileddescriptions thereof will be provided below with reference to FIGS. 55and 56.

The content playing apparatus 1200 may include the communication unit1210, the controller 1220, and the storage unit 1230, and the controller1220 may include the recognition manager 1221.

The communication unit 1210 receives the images from the userrecognition apparatus 1100 and transmits the received images to thecontroller 1220, and also receives content from the server 1300 andtransmits the received content to the controller 1220.

The controller 1220 may recognize the users and select a user. Therecognition manager 1221 receives, from the user recognition apparatus1100, images of the users viewing the content and may recognize faces,body shapes, or the like, of the users from the received images.Alternatively, the recognition manager 1221 may analyze voices of theusers received from the user recognition apparatus 1100.

When the users are recognized, the recognition manager 1221 may selectat least one of the users according to predetermined criteria. Forexample, the recognition manager 1221 may select the youngest user or auser who performs a certain action. When the selection is completed bythe recognition manager 1221, the controller 1220 may transmit a userrecognition result and a user selection result to the server 1300 viathe communication unit 1210.

The controller 1220 may use the information, which is necessary toperform the processes of recognizing the users, selecting a user, etc.,by accessing the storage unit 1230. User information required torecognize the users and select a user may be stored in the storage unit1230.

The server 1300 may include the communication unit 1330, the controller1320, and the storage unit 1310, and the controller 1320 may include arestriction manager 1322. The communication unit 1330 of the server 1300may be connected to the communication unit 1210 of the content playingapparatus 1200 via a network such as Internet.

When a content request is received from the content playing apparatus1200, the controller 1320 of the server 1300 extracts a piece of contentwhich is requested from among pieces of content and transmits theextracted piece to the content playing apparatus 1200.

In this case, the restriction manager 1322 included in the controller1320 of the server 1300 controls the playing of the content according tothe selected user. For example, the restriction manager 1322 comparesthe age of the selected user against a viewing rating of the content inorder to determine whether the selected user is allowed to view thecontent. If the selected user is not allowed to view the content, therestriction manager 1322 may stop playing the content or reprocess thecontent and transmit the reprocessed content to the content playingapparatus 1200.

The content playing apparatus 1200 transmits content playing data thatis controlled to the communication unit 1040 of the display apparatus1000 via the communication unit 1210, and the display apparatus 1000converts the received content playing data and may output images andvoices to the output unit 1030.

FIG. 55 is a view of a system configured to control playing of content,according to an exemplary embodiment. Referring to FIG. 55, the systemmay include the display apparatus 1000 and the server 1300. Also, thedisplay apparatus 1000 may include the user recognition apparatus 1100.A detailed structure and operation of each component of the system willbe described with reference to FIG. 56.

FIG. 56 is a view of detailed structures of devices included in thesystem of FIG. 55, according to an exemplary embodiment. While devicesnecessary to perform the present exemplary embodiment are illustrated inFIG. 56, the system may further include common devices other than theillustrated devices.

In the system of FIG. 56, the server 1300 performs all processes such asprocesses of recognizing users, selecting a user, determining whether torestrict content, and restricting the content without a separate devicefor playing content.

Referring to FIG. 56, the display apparatus 1000 may include thecommunication unit 1040 and the output unit 1030 as shown in FIG. 53 andmay further include the user recognition apparatus 1100. Therefore, theuser recognition apparatus 1100 captures images of the users, and thecaptured images are transmitted to the server 1300 via the communicationunit 1040.

Operations of the communication unit 1040 and the output unit 1030 ofthe display apparatus 1000 are the same as described with reference toFIG. 53, and thus, repeated descriptions will be omitted.

The server 1300 may include the communication unit 1330, the controller1320, and the storage unit 1310. The controller 1320 may include therecognition manager 1321 and the restriction manager 1322. Thecommunication unit 1330 of the server 1300 may be connected to thecommunication unit 1040 of the display apparatus 1000 via a network suchas the Internet.

When a content request is received from the display apparatus 1000, thecontroller 1320 extracts a piece of content which is requested fromamong pieces of content and transmits the extracted piece to the displayapparatus 1000 via the communication unit 1330. In this case, therecognition manager 1321 and the restriction manager 1322 perform theprocesses of recognizing the users, selecting a user, determiningwhether to restrict content, and restricting the content by usingcaptured images of the users which are received from the displayapparatus 1000.

When the images of the users viewing the content are received from thedisplay apparatus 1000, the recognition manager 1321 may analyze faces,body shapes, or the like, of the users from the received images.Alternatively, the recognition manager 1321 may analyze voices of theusers received from the display apparatus 1000.

When the users are recognized, the recognition manager 1321 may selectat least one of the users according to the predetermined criteria, forexample, the youngest user or a user who performs a certain action.

When the selection is completed by the recognition manager 1321, therestriction manager 1322 controls playing of the content according tothe selected user. For example, the restriction manager 1322 comparesthe age of the selected user against a viewing rating of the content inorder to determine whether the selected user is allowed to view thecontent. If the selected user is not allowed to view the content, therestriction manager 1322 may stop playing of the content or reprocessthe content and transmit the reprocessed content to the displayapparatus 1000.

The controller 1320 may use information, which is necessary to performthe processes of recognizing the users, selecting a user, determiningwhether to restrict the content, restricting the content, etc., byaccessing the storage unit 1310. User information required to recognizethe users and select a reference user as well as content-relatedinformation required to determine whether to restrict the content may bestored in the storage unit 1310.

FIG. 57 is a view of a system for controlling playing of content,according to an exemplary embodiment. Referring to FIG. 57, the systemmay include the display apparatus 1000, the user recognition unit 1100,and the content playing apparatus 1200. The system of FIG. 57 does notinclude a server, and the content playing apparatus 1200 directlyprovides content and controls playing of the content. A detailedstructure and operation of each component of the system will bedescribed with reference to FIG. 58.

FIG. 58 is a view of detailed structures of devices included in thesystem of FIG. 57, according to an exemplary embodiment. While devicesnecessary to perform the present exemplary embodiment are illustrated inFIG. 58, the system may further include common devices other than theillustrated devices. The system of FIG. 58 does not include a server,and the content playing apparatus 1200 directly provides content andcontrols playing of the content. That is, the content playing apparatus1200 directly provides content by using a content playing driver 1240without receiving content from an external server. In this case, thecontent playing driver 1240 is configured to play content recorded in astorage medium such as a CD/DVD driver or a universal serial bus (USB)driver.

Referring to FIG. 58, the display apparatus 1000 may include thecommunication unit 1040 and the output unit 1030. The output unit 1030may include the image output unit 1031 and the voice output unit 1032.The image output unit 1031 may be, for example, an LCD, an OLED displayhaving a screen that displays content. The voice output unit 1032 maybe, for example, a speaker. The display apparatus 1000 receives, fromthe content playing apparatus 1200, data used to play the content viathe communication unit 1040 and may output the received data to theoutput unit 1030 as images or voices.

The user recognition apparatus 1100 may include the camera 1111 forcapturing images and the communication unit 1120 for transmitting thecaptured images. Also, the user recognition apparatus 1100 may furtherinclude the voice detection unit (not shown) for detecting voices of theusers. The user recognition apparatus 1100 may be embodied as anapparatus separated from the display apparatus 1000 or a camerainstalled in a frame of the display apparatus 1000. Detaileddescriptions thereof have been provided with reference to FIGS. 55 and56.

The content playing apparatus 1200 may include the communication unit1210, the controller 1220, and the storage unit 1230, and the controller1220 may include the recognition manager 1221 and the restrictionmanager 1222.

The communication unit 1210 receives the images from the userrecognition apparatus 1100 and transmits the received images to thecontroller 1220, and also receives content from the controller 1120 andtransmits the received content to the display apparatus 1000.

The controller 1220 may perform processes of recognizing the users,determining whether to restrict the content, and restricting thecontent. The recognition manager 1221 receives, from the userrecognition apparatus 1100, images of the users viewing the content andmay recognize faces, body shapes, or the like, of the users from thereceived images. Alternatively, the recognition manager 1221 may analyzevoices of the users received from the user recognition apparatus 1100.

When the users are recognized, the recognition manager 1221 may selectat least one of the users according to predetermined criteria. Forexample, the recognition manager 1221 may select the youngest user or auser who performs a certain action.

When the selection is completed by the recognition manager 1221, therestriction manager 1222 controls playing of the content from thecontent playing driver 1240 according to the selected user. For example,the restriction manager 1222 compares the age of the selected useragainst a viewing rating of the content in order to determine whetherthe selected user is allowed to view the content. If the selected useris not allowed to view the content, the restriction manager 1222 maystop playing of the content or reprocess the content and transmits thereprocessed content to the display apparatus 1000.

The controller 1220 may use information, which is necessary to performthe processes of recognizing the users, determining whether to restrictthe content, restricting the content, etc., by accessing the storageunit 1230. User information required to recognize the users and select areference user as well as content-related information required todetermine whether to restrict the content may be stored in the storageunit 1230.

While the inventive concept has been particularly shown and describedwith reference to preferred exemplary embodiments thereof, it will beunderstood by those skilled in the art that various changes in form anddetails may be made therein without departing from the spirit and scopeof the inventive concept as defined by the appended claims. Thepreferred exemplary embodiments should be considered in descriptivesense only and not for purposes of limitation. Therefore, the scope ofthe inventive concept is defined not by the detailed description of theinventive concept but by the appended claims, and all differences withinthe scope will be construed as being included in the inventive concept.

The exemplary embodiments of the inventive concept can be written ascomputer programs and can be implemented in general-use digitalcomputers that execute the programs using a computer-readable recordingmedium. Examples of the computer-readable recording medium includemagnetic storage media (e.g., ROM, floppy disks, hard disks, etc.),optical recording media (e.g., CD-ROMs, or DVDs), etc.

What is claimed is:
 1. A content playing system comprising: an outputdevice including a display and a speaker; and one or more controllers,each including a processor, configured to: recognize a plurality ofusers viewing content output by the output device based on one or morecaptured images including the users, predict ages of the recognizedusers, select at least one of the recognized users based on thepredicted ages, and control the output of the content according to ayoungest age from among the predicted age of the at least one selecteduser, and wherein the one or more controllers are configured to receiveat least one voice signal including at least one voice of the at leastone user among the plurality of recognized users viewing the content,via a microphone, perform voice recognition on the at least one voicesignal, obtain a conversation of the at least one user among theplurality of recognized users viewing the content based on a result ofthe voice recognition, the obtained conversation corresponding to the atleast one voice signal, and recognize an additional user based on theconversation.
 2. The content playing system of claim 1, wherein the oneor more controllers are configured to predict the ages based on one ormore of faces, voices, and body shapes of the recognized users, anddetermine the youngest age from among the predicted ages.
 3. The contentplaying system of claim 2, wherein the one or more controllers areconfigured to determine a viewing rating based on analysis of thecontent and compare the determined viewing rating against the youngestage in order to determine whether to output some or all of the content.4. The content playing system of claim 1, wherein the one or morecontrollers are configured to detect a change in the number of usersviewing the content being output, and repeat the recognizing,predicting, selecting, and controlling when the number of users changes.5. The content playing system of claim 1, wherein the one or morecontrollers are configured to predict that the additional user notincluded in the one or more captured images will be added at a latertime as a user viewing the content based on analysis of the conversationof at least one user among the plurality of recognized users viewing thecontent, the conversation including information representing theadditional user, and select at least one user from among the pluralityof recognized users and the predicted user.
 6. The content playingsystem of claim 1, wherein the one or more controllers are furtherconfigured to recognize activities of the recognized users, select atleast one recognized user performing a predetermined activity, andcontrol output of the content according to a preference of the at leastone recognized user selected by performing the predetermined activity.7. The content playing system of claim 6, wherein the one or morecontrollers are configured to generate for display, on the outputdevice, a list of channels or a list of content preferred by the atleast one recognized user selected by performing the predeterminedactivity.
 8. A method of controlling playing of content on an outputdevice including a display and a speaker, the method comprising:recognizing a plurality of users viewing the content based on one ormore captured images including the users; predicting ages of therecognized users; selecting at least one of the recognized users basedon the predicted ages; controlling output of the content according to ayoungest age from among the predicted age of the at least one selecteduser, wherein the predicting comprises: receiving at least one voicesignal including at least one voice of the at least one user among theplurality of recognized users viewing the content, via a microphone,performing voice recognition on the at least one voice signal, obtainingthe conversation of the at least one user among the plurality ofrecognized users viewing the content based on a result of the voicerecognition, the obtained conversation corresponding to the at least onevoice signal, and recognizing an additional user based on theconversation.
 9. The method of claim 8, wherein the predicting of theages is based on one or more of faces, voices, and body shapes of therecognized users, and the method further comprises determining theyoungest age from among the predicted ages.
 10. The method of claim 9,wherein the controlling comprises: determining a viewing rating based onanalysis of the content; comparing the determined viewing rating againstthe youngest age in order to determine whether to output some or all ofthe content.
 11. The method of claim 8, wherein the recognizing,predicting, selecting, and controlling are performed whenever the numberof users viewing the content changes.
 12. The method of claim 8, whereinthe recognizing, the predicting, selecting, and controlling areperformed whenever the content being output changes.
 13. A system forcontrolling output of content by an output device including one or bothof a display and a speaker, the system including: one or morecontrollers configured to: recognize users viewing and/or listening tothe content based on one or more captured images including the users,predict ages of the recognized users, select at least one of therecognized users based on the predicted ages, and control output of thecontent according to a youngest age from among the predicted age of theat least one selected user, wherein the one or more controllers areconfigured to receive at least one voice signal including at least onevoice of the at least one user among the plurality of recognized usersviewing the content, via a microphone, perform voice recognition on theat least one voice signal, obtain a conversation of the at least oneuser among the plurality of recognized users viewing the content basedon a result of the voice recognition, the obtained conversationcorresponding to the at least one voice signal, and recognize anadditional user based on the conversation.
 14. The system of claim 13,further comprising: a camera for capturing images of the users for useby the one or more controllers in recognizing the users.
 15. The systemof claim 13, further comprising: a microphone for capturing sounds ofthe users for use by the one or more controllers in recognizing theusers.
 16. The system of claim 13, wherein the one or more processorsare further configured to determine correctness of the predicted agesbased on an input to the system indicative of the correctness.
 17. Acomputer program product comprising a non-transitory computer-readablestorage medium configured to store one or more computer programsincluding instructions that, when executed by at least one processor,cause the at least one processor to control to perform the method ofclaim 8.